Evidence for the droplet/scaling picture of spin glasses 
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We have studied the Parisi overlap distribution for the three-dimensional Ising spin glass in the 
Migdal-Kadanoff approximation. For temperatures T ~ 0.7Tc and system sizes up to L = 32, we 
found a P{q) as expected for full Parisi replica symmetry breaking, just as was also observed in recent 
Monte Carlo simulations on a cubic lattice. However, for lower temperatures our data agree with 
predictions from the droplet or scaling picture. The failure to see droplet model behavior in Monte 
Carlo simulations is due to the fact that all existing simulations have been done at temperatures 
too close to the transition temperature so that system sizes larger than the correlation length have 
not been achieved. 
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Despite over two decades of work, the nature of 
the low-temperature phase of the three-dimensional 
Edwards- Anderson spin glass remains controversial. 
While the best available computer simulation results to 
date have been interpreted as suggesting a mean- 

field like behavior with replica-symmetry breaking (RSB) 
and a variety of different pure states 0| , analytical argu- 
ments H] favor a droplet picture ||^-^ , in which there are 
only a single pair of spin-flip related pure states. It is the 
purpose of this paper to present evidence that the appar- 
ent RSB observed in Monte Carlo simulations is due to 
the relatively small system sizes used and the proximity 
of the simulational temperature to Tc, so that these sim- 
ulations merely probe the crossover region between the 
critical behavior and the true low-temperature behavior. 

The droplet picture differs from mean-field theory most 
dramatically in the overlap distribution function 



Piq,L) = L^/-^PiqL^/n, 
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Here, the superscripts (1) and (2) denote two replicas of 
the system, = L"^ is the number of spins, and (...) and 
[...] denote the thermodynamic and disorder average re- 
spectively. The coefficients Xi can be chosen in several 
ways, as discussed below. We use P{q, L) to denote the 
overlap for a finite system of size L, reserving the more 
standard notation P{q) to refer to the asymptotic form 
\miL^ooP{q,L). 

In the mean-field RSB picture, P(0) is finite in the 
spin-glass phase, while it is zero in the droplet picture. 
The main support for the mean-field picture comes from 
the observation that P{0, L) does not decrease with in- 
creasing system size in systems up to size N — — 16'^ 
at temperatures as low as CTT^. However (and this is the 
main motivation for our work), even within the droplet 
picture one expects to see a stationary P(0, L) for a cer- 
tain range of system sizes and temperatures. The reason 
is that at Tc the overlap distribution P{q^ L) obeys the 
scaling law 



f3 being the order parameter critical exponent, and i' the 
correlation length exponent. In d = 3, /3/:^ ~ 0.3 [||, 
implying that the critical P(0, L) increases with L. On 
the other hand, in d = 3, the droplet picture predicts a 
decay 

P(0,L)^l/i'^ 

with an exponent 9 ~ 0.17 when L is larger than the 
(temperature-dependent) correlation length. Thus, for 
temperatures not too far below Tc, one can expect an 
almost stationary P(0, L) for a certain range of system 
sizes. Since both f3/i/ and 9 are rather small, this ap- 
parent stationarity may persist over a considerable range 
of system sizes L. We will argue that this is the correct 
interpretation of the simulation data at T ~ O.lTc re- 
ported in 1^. This possibility was discussed in |9| where 
the authors studied the four dimensional EA spin glass 
by Monte Carlo simulations. However, they concluded 
that their Monte Carlo data could not be interpreted in 
these terms. We will comment on their work at the end 
of this paper. 

In the following, we will study the overlap distribution 
for the three-dimensional Edwards- Anderson spin glass 
in the MK approximation. Compared to Monte Carlo 
simulations, the MK approximation has the advantage 
that system sizes up to L = 32 and temperatures down 
to G.2Tc can be investigated with only a few days' CPU 
time. Since the MK approximation has proven to give 
good results for the phase diagram and the critical expo- 
nents of the three-dimensional spin glass [lO[ | , we expect 
that it will also capture the main features of the overlap 
distribution. Furthermore, it was shown analytically in 
]lT[ that in infinite dimensions (and in an expansion away 
from infinite dimensions) the MK approximation gives 



Piq) = (l/2)(,5(g + ^ea) + Siq - ^ea)), 



(3) 
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just as is expected in the droplet picture. In the present 
paper we shall investigate the role of finite size effects 
on the overlap distribution function, i.e., P{q,L) for a 
commonly used Ising spin glass model. 

The Edwards- Anderson spin glass in the absence of an 
external magnetic field is defined by the Hamiltonian 

H = — ^ JijSiSj, 

where the Ising spins can take the values ±1, and the 
nearest-neighbor couplings Jij are independent from each 
other and Gaussian distributed with a standard deviation 
J. Evaluating a thermodynamic quantity in MK approx- 
imation in three dimensions is equivalent to evaluating it 
on an hierarchical lattice that is constructed iteratively 
by replacing each bond by eight bonds, as indicated in 
Fig. 1. The total number of bonds after I iterations is 
8^, which is identical to the number of lattice sites of a 
three-dimensional lattice of size L — 2^ . Thermodynamic 
quantities are then evaluated iteratively by tracing over 
the spins on the highest level of the hierarchy, until the 
lowest level is reached and the trace over the remaining 
two spins is calculated This procedure generates 

new effective couplings, which have to be included in the 
recursion relations. 



FIG. 1. Construction of a hierarchical lattice. 

The coefficients Xi in Eq. (|l]) are often chosen to be 
equal to 1 for all i. In fact, for a cubic lattice this is the 
most natural choice since all the spins then have the same 
coefficients. However, on a hierarchical lattice where not 
all spins are equivalent, the more natural choice is one 
which ensures that all the bonds occur with the same 
coefficient, i.e.. 
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where {ij) is a sum over all bonds ||Tl[ and Nl is the 
number of bonds. Our numerical results presented below 
are for this second choice, but we have found very similar 
results for the first choice of Xi. 

It is possible to calculate P{q, L) directly from the 
above definition Eq. (|l|). However, it is more expedient to 
first calculate the Fourier transform F{y,L) of P{q,L), 
which with the choice of Eq. (H) is given by pTI] 




2Nl ^ 
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The recursion relations for L) involve two- and four- 
spin terms, and can easily be evaluated numerically. The 



Parisi overlap distribution is a sum of a large number 
delta function terms corresponding to the possible pro- 
jections of the spins in one replica onto the spins in the 
second replica i.e. 



Nl/2 

E 

n=-NL/2 



(6) 



The coefficients a„ can be evaluated from F{y,L): 

rTTNL/2 

an = / Fiy, L) cos{2yn / N L)dy . {7) 

Jo 

Our numerical results are illustrated in the next five 
figures. In all simulations we made sure that the range 
and number of y values, as well as the number of sam- 
ples, were sufficiently large to give reliable results. Fig. 2 
shows P{q, L) for 2, 3, 4, and 5 iterations, averaged 
over up to 10000 realizations of randomness, and for 
T = 0.7Tc, where w 0.88 J 0. We have displayed the 
P{q,L) as smooth curves, rather than as a large num- 
ber of delta function spikes for ease of viewing. These 
curves correspond to system sizes L = 4, 8, 16, 32. Since 
P{q,L) = P{—q,L), the curves are only shown for posi- 
tive q values. Just as in the Monte Carlo simulations of 
@-||, the value of P{0,L) and the area under the main 
peak hardly change with L, a result which is compatible 
with the RSB picture. 




FIG. 2. P{q,L) at T ~ O.TTc, averaged over 5000-10000 
bond realizations of the randomness 

In contrast to the Monte Carlo simulations, our P{q, L) 
has not only two large peaks, but also seven smaller 
equidistant peaks, or bumps. This indicates that certain 
overlap values occur more often than their neighboring 
values and arises from the hierarchical structure of the 
lattice: the 6 spins that are traced over last, have the 
highest coordination number, and the 8 "bubbles" sitting 
between those spins are to some degree slaved to the state 
of these spins. If we assume that each "bubble" has two 
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flip-related states, we find 9 equidistant preferred values 
for the overlap. For MK approximation in two dimen- 
sions, the same argument gives 5 preferred values, and 17 
in four dimensions. We have confirmed these predictions 
by calculating P{q, L) in 4 and 2 dimensions. In two di- 
mensions, we chose a ferromagnet, in order to make sure 
that the bumps are independent of the spin-glass proper- 
ties. As will be seen from our low-temperature data, only 
the peak at qea survives in the thermodynamic limit. 



We now discuss the remaining part of our results. In 
Fig. 7 of ||l[ the authors plotted the overlap distribution 
for a single sample of a cubic Ising spin glass, i.e., with- 
out averaging over the disorder. These distributions have 
in general several peaks and look very different for differ- 
ent samples, just as they would in the presence of RSB. 
Fig. 3 shows our equivalent result for four randomly cho- 
sen samples at T = 0.7Tc and L = 32. The good agree- 
ment with the Monte Carlo data shows again that the 
MK approximation reproduces one of the main features 
of the three-dimensional spin glass simulations. Inciden- 
tally, it is this large sample to sample variation which 
requires one to average over very large number of bond 
realizations of the randomness to get smooth averaged 
expressions for P{q,L). 
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FIG. 3. The overlap distribution for four different bond 
realizations, at T = O.TTc and L = 32. 



While numerical data at temperatures around T — 
0.7Tc are compatible with RSB, data for lower temper- 
atures are in favor of the simpler droplet picture. For 
T = 0.38Tc, e.g., P{q,L) decreases with increasing sys- 
tem size for small values of q, the area under the sub- 
sidiary bumps decreases, and the area under the main 
peak increases, as shown in Fig. 4. 




FIG. 4. P{q,L) at T ~ 0.38rc, averaged over 5000-10000 
bond realizations. 



In order to make these qualitative statements more 
quantitative, we have evaluated P(0, L) for a variety of 
temperatures and system sizes, each point again being 
averaged over 5000-25000 samples (Fig. 5). 
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FIG. 5. The value of P{0,L), and its standard error, as 
function of the system size, for T/Tc =1, 0.7, 0.54, 0.38, 0.2 
(from top to bottom). The straight lines are power-law fits 
with the exponents 0.24, 0.053, -0.084, -0.13, -0.24 (from high 
to low temperatures). 

One can clearly see that for lower temperatures P(0, L) 
decreases with increasing system size, without any indi- 
cation of a saturation at a nonzero value. For the lowest 
simulated temperature, the decrease is characterized by 
the exponent 9, as predicted by the droplet picture. (In 
[|l^,0, 6* ~ 0.26 is found in MK approximation.) On the 
other hand, the data at Tc are compatible with the expo- 
nent f3/iy ~ 0.26 obtained earlier ||l^]. The data sets for 
intermediate temperatures each cover a small window of 
less than one decade in the system size L in the crossover 
region between the two limiting regimes. With this small 
range of L- values, one does not see the crossover expected 
at larger system sizes to a line with the slope —6. But 
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one sees an effective exponent in the range before this 
asymptotic behavior sets in. Because the behavior is so 
weh described by an effective exponent, it is not possible 
to obtain a rehable estimate of the correlation length. 
The only statement one can make is that for tempera- 
tures above O.SSTc the correlation length would seem to 
be (much) greater than 32 lattice spacings. This seems to 
rule out any possibility of achieving a satisfactory simu- 
lation of the three dimensional spin glass phase with cur- 
rent computers and algorithms. (Simulations at low tem- 
perature, where the correlation length is certainly small, 
are very hard as the spins are almost totally frozen up 
on typical simulational timescales). 




to L = 8. This indicates that at T ~ 0.67Tc, the sys- 
tem is not yet in the asymptotic regime for system sizes 
L < 8. However, since the exponents f]/^ and 9 are much 
larger in four dimensions than in three dimensions, the 
change in the slope of In P(0, L) vs In L must be faster in 
four dimensions than in three dimensions. Therefore, if 
one goes to somewhat larger system sizes than in Q, it 
might actually be possible to escape the effects of critical 
fluctuations and see features characteristic of the low- 
temperature phase proper, in contrast to the situation in 
three dimensions, where escape from critical fluctuation 
effects seems impossible. 

In summary, the MK approximation gives clear ev- 
idence that the apparent RSB behavior of the three- 
dimensional Edwards- Anderson spin glass reported in 
is due to finite size effects arising from the closeness 
of the temperatures studied to the critical temperature 
Tc so that the correlation length is larger than the linear 
dimension of the systems studied. 
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FIG. 6. The overlap distribution at T = Tc, for L = 4 
(solid), 8 (dotted), 16 (dashed). The inset shows a scaling 
collapse P{q,L)/L°-^'^ vs qL°-^^. 



The simulational data [yg] is also purported to provide 
evidence for a non-trivial ultrametric topology amongst 
the alleged multiplicity of pure states. However, it has 
been known for many years that such behavior can again 
be an artifact of finite size effects when the correlation 
length becomes comparable with the linear dimension of 
the system |l3| . 

Finally we comment on results in four dimensions. 
While it is suggested in Q that the mean-field RSB pic- 
ture cannot hold in any finite dimension, Monte Carlo 
data for temperatures T ~ 0.67Tc show a saturation of 
P(0, L) for system sizes up to i = 6, after an initial de- 
cline for sizes L = 2 and 3 ||] . It is quite possible that the 
Monte Carlo data for L — 2,3 cannot really be trusted 
and the decrease seen by these authors is attributable 
to some finite size effects. In fact, it has been noted in 
other studies that P{q,L — 2) does not scale well close 
to criticality . We studied the four dimensional prob- 
lem briefly within the MK scheme. We will not display 
our data here, but simply state that they also show a 
stationary P(0, L) at T ~ 0.67rc for 2 and 3 iterations, 
i.e. for L = 4 and L = 8. However, at T ~ 0.33Tc, 
we see a clear decline in P(0, L) when going from L ~ 4 
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